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) To obtain user evaluations of the information 

analysis prcducts flAPs) produced by the /Educational , Resourr:es 
Information Cienter Clearinghouse on Tes^s, Beasuremen-^,. and 
, Evaluation |ERIC/TM) , subjects were ratiidomly drawn . from a '1976 list 
ot the clearinghouse's "lAP orders, Th4 sample was sttatiiied by the 
title requested and the^f ollowing institutional affiliations: (1) 



, ^y^^^^^j « **^y« indicators of quality 

were document length, organization, writing, and format, Utility was 
judged according to* the put pose for ordering the document ^ whetiter 
the document was passed on (if so, to whom and what~I)or) , af(|*^^he 



document's impact on the requestor 's. subsfsquent work^iictivijt'4^»Vr^^ 
evaluations pf ERIC/TM's products, tend to be high and indica^^© t]^t 
the publications are used as Preference tools Jby^ educators to kee]^' 
abreast o^ the literatui?e, TheZ.guestionnaire and resulting data ai 
a;^pended, (JAC) 
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INTRODUCTION 



The research dealing with the needs and uses of ^ 
information has uncjergone thange since the 19,50' s, ^tak- 
ing three basic formst The first fornL_gimsi£ 
dxaminirig users '^rrchkr^ct^ri^^ re- 
laitionships to .the types of info'rmatidn used; the second 

deals with theoretical approaches Isp information .dissem- 

. ' ^ . . ^ * C 

ination; the third type focuses on evaluations pf existing 

information systems and their impact on the consumer arid"' 

'practitioner . The first type, which categorizes users'* * 

needs, and relates them to characteristics of the users 

themselves, was used primarily fr<^m the 1950' s until 

the mld-r960* s and was Icfrgely concerned wilih. the^cha'iiac- / 

teristics of the ' consumers of, scieritif ic and technological 

inf orrtiation . fiartyn" (1974), ih. a review of the development 

of user-needs-and-uses research,' terms this type of re- . 

search •*broad;^^r^ush studies" and sees its general purpose 

as ex^J^oratory i^;; that the diesired end produat was some 

quantification, of information-gathering habits. and needs ^ 

in order^' to improve the quality of. the inf prmatj.on , ser- . 

\ ' . . • ■ ' ' ■ 

vices being of fejred • * - 

In reviewing sue 
Lin ahd "Garvey (1972) delineate some of the factors 



In reviewing such studies of ^information needs. 




involved in accounting for dif f erential ;iAf^J^niatibrt 

. • • ' i " • • • ■ 

■sibly/ the mosti important factor influencing s^Cft' rjeeds , 

s the type of work performed by the' user) suc)rx_^. as teacWijig 

r r^esearch. Although many individuals are Engaged in / 

both activ^les,! they may be classified according 'to how 



they ^penji the majority of their time. Lin and Garvey'' 
point oubXthat/ whether the person classifies hinr or herself 
as pri\xnarily\\te^c^er or researcher' has an effect on the 



quantity, quali 
Because they are 



and form of the infomation needed. 



afe^mpting'^^^ establish "priority of 



scientific 'discoj/ery i^S^esearchersi need both a* large amount 
V of information afe well asixmore current publications than 
do teachers, whojare involvei^ in more applied work. 

Another Taci^or influencing differential irtfo^raiation 
needs is whether the individual's wdrk is baai^ or applied. 
In a s^udy of the; information uses- of socia';!: scientists 
in Britain, Line, . Brxttam, and Crammer C/I971> report 
^ that those ^ople employed by educatiorla* institutes,, 
who are doing more basic work, report more frequent use 



of abstracts than do those in 'more'^pjpii^ work in govern- 
ment settings. 



The specific discipline in which the information 
user is involved is another factor .affecting differential 
needs-. Jn^^S-^omparative study of the communication* systems 
within the physical- and social sciences, Garvey, Lin, and 
N^son (1970) report /^girious^differences between the two 
^'with ^respect 'to the * operation of the elements of the ' 



■ ■-, ■ -. i> - ■ ' ' \ 

systems.' In||jeneral, communication in the social sciences 
•seems to be in the early stages of development in rela- ^ 
tion to the dey«n.opment exhifcite'd by the physical sciences 
in that within soci'al sciences, communication seems more 
random than systematic. The processing of. infprmation 
within the social sciences seems to be more tfdlfl^jiconsuming, 
haphazard, and diffuse than in the physical science? . 

. A fourth factor affecting differential needs, ^men- 
tioned by Lin and Garvey, is the user's* knowleiige of the 
facilities and/or materials available. ' Studies "evaclu-- 
ating the sej;yices of the Educational Resources Inforirta- 
tion Center (EJRIC) have emphasized . that^ one of the most 
importa^nt problems encoiontered by EI^IC h^^s been under- 

uti'lization and lack of awareness by potential users 

' ■ * 

of^the availability of the services (Garvey,- et al/,_^1970; 

\ • • . ■ . . 

. HooveV, 1972; Wanger, 1972). Hoover (19720 cites variou^ , 
• factors as causes of underutilizata^n of the services 

^ offered by ERIC. Among those mentioned are lack of vtt^sl- 
bility, accessibility, and practical utility of, the infoir- 
mation, and a lack of information retrieval^ sl^ills among \ 
educators . ' " ^ 

The second bas.ic form of research, concerned with . 
information .(dissemination and users' needs and usfes, 
is .characterized by a more sociological, approach which 
attempts to develop theories of information-processing ' 
behavior as opposed to simply describing such behavior. 
Paisley (1968) summarizes some of the. quest:! on^b'^ught 



" . . . ■ ■ . ■. ^ . • : 

" out by such arji approach and Tincludeg among them the. par-, 
' "ticular media chosen and the amount- of ^'effort associated 
; With the information-processing behavior • This eocio- 

' logical approach ' emphasizes the need to take into ' account ' ^ 

• the various systems , in which the information user is 

1 • . ■ ■ • ■ . . . •■ ' ■ ' . 

^ . involved, such as the cultural, politj^cal and economic . 

Systems described by Pa'islfey. By considering these in- ' 
. , formation* spheres, thiS research appi^oach leads tOra greater 
understanding of the ••infoimial communication system-/ ' * 
Among the concepts used to analyze the informal'• 
'^ communication systems is that of ••invisible colleges." 
T|iese colleges' can be thought of as a group, of prestigious 
iresearcher^ in a subfield of a science who know one another 
and^ share information informally. ^arvey and Griffith - 
1 xjL (1968) have poiijted out that this * informal. Cpmnjunicat ion 
within an invisible college of results "^Ic)! ^jt;'e "^ot 
published elsewhere teji^d.s to restrict availabi'lity of 
-the information from younger researchers who have no j 

such acpess. v 

J *■ ■ ' ' ' ■* 

Another group of studies in this sociological vein, 
, performed by the Center for Research in Scientific Commun- 
ication at Johns Hopkins Universit:y, investigated the role' 
""played by the various ^mediS used in scientific and tech-, 
nical communication' .(Garvey> Lin, Nelson, ^hd Tomita, 1970)\ 
The first series of - these studies dealt with the communi- 
cation processes involved in the national meeting^ 'of > 
various, engineering, physical, and sgcial science 



societies. The authors- provide a detailed description 

0f thd information-exchanging, activities associated with 

papers preisented at. these^national meetings using i^^aponse 

obtained from quest ij^nnaire^ submiibted to the authors 'O'f 

✓ - / J, • ■ '• ' _ 

the papers, 1;he ses^sion atbertdants, and the ^questors 

of' the papers* ' ' • , ■ • ^ 

^ ; On the basis' ^Df the attendants', requestors', and 
authors' r'esponses to these questipnnaires, thfe authors 
Of the study came to some -juBgirient as t.o' -the effective-*-^ 
ndss of the information exchanged^ at thes^ nieetings. 
The authors conclude .-that the participants »view.^ the -,. . ' 
•national meeting, as one of the last informsil^ ^scientific 
coniromiicati oil media and *wi'sh to keep it, so d^spite the . 
increasing, size df.the meetings. The basic information,- ' ^ 
, exchange . functicjn served by the meeting , is to announce, 
new scientific work and to allow a fruitful exchange' of 
infqrmation after thie paper presentation. Pointing out • . 
that the information dissemination by requested^ copy ^ 
is more important to the active researcher than the same''^ 
information later published in journals, the authors' ^ 
suggest that to provide increased and more effective 
communication, the 'societies themselves might be^ respon-^' * 
S'ible.. f o^:;distributi papers rather ^han' leaving , 

the^^sponsibiaity to the author who. might find him or . 
heraelf ,too busy. 

The spciological approach to information-processing 
and dissemination adds to basic toiowledge but^-has 1' tie ^ 



effect. On existing Inf orfnation systems and *their 'designers . 
During the 19j50 • i^rnany innovations were made in' the^inr 




formation systems ,^«uch as computerized storage and retrievjal 
Because these changes invplved high levels of effort 
and co'st^> 't-he primary area of ii7terest in user ; studies 
"■^y switched from basic knowledge to evaluations of these'*"' , 
new systems. Specifically, researchers beca^me concerned 
with the impact of the information provided by these 
systems, ori; the subsequent of the users. The designers; 

andC managers of the many systems which were fojrrned aft^r 
the computer became an integrar part of^ the infdrmatibh 
' dissemination 'Process wanted feedback on t'lje users*, eval- 
ua^tibris of the informa1;ion being processed;' th^retfbreV 
•numerous studies were undertake^ -to gui4e and modify'fthe 
operations of certain systems. \,'C\Jf ' ..^ . 

In one such stiidy,. Hall and her as^bciates .(1972) 
• analyze usersV eva.luation^ of the services offerled by 

Information Services 'in P]iysics/ Electrotechnology , Cpm^ . 
I puters and Control (INSPEC) . The investigators ' found 
I that, in general, users* reactions to and juagraents of 
j a servie^, ar^ based on subjectiv-e impres.si.on^ related 



to such things as the physical^appearallce of the output, 
in a' similar vein, 'Hall (1972) examined users', reactions 



.to selective dissemination information services and found 
±hat, over a period , of up to two ancl a half yeats, ^the 
users report increased confidence in^being ' well ii;if ormed, 
a, reduction in the number of journals scanned. by 'satisfied 



users, and fewer visits to the library by selective dis- 

semination in£ormati*on recipients • ^ TheraTore, in tliese 

studies, it i's shown that a successful .system can have / 

a positivjp effect on the behavior of thel tisers.. / 

' . . ' •• • ; * ^ : '' / 

Educational .^Resources ^. Irt formation : C^enter (ERIC ) ; ^ / 

• r ' . ' ' . • ' ' * . " / 

IS an information system which has been thq object of ^ 
much, investigatibn. ERIC- 'is a system that' provides ff^i 
the compilation and dissemination of current' 'educcLtional 
literature. A'netwo-r}^ of^l6 clearinghouses has primary . • 
resporisibility for. the collecting and^ indetcing of ma/teri^ 
t;0 be included in the system. In addition to perfQjrming 
computeri'zipd sear:ches on specific topics, each of iuhe 
clearinghouses . procluces Information Analysii^. Products . 
•(lAP) "Which are summaries and' bibliographies prepared 



on imponrtant t,opics intended to help those in ed^iication 

' ■ ■ . ' " '/'■"' ■ ■' 

remain abreast; ^of research. Various studies ha^e foqused ■ 

on the effectiveness of ERIC and the services -^ffered. / 

■'^ One s^ch .study is that by G.arrvey, et al./ (i970)., 

mentioned previously, which dealt with the role, of the 

national meeting in scientific and technicq/l communicatipn-.^ 

As part of their research, the authors investigated the. 

■ ^' ■■■ ■ I ■ 

use of ERIC by the-authors, attendants,' and requestors 
of meeting papers presented at the American Educational 
Research Association meeting . Their resurt? intlicate . ) a - . 
-that in 1967' only .30?^ of the res]^oridents in ; the survey 
had personalflly submitted a document^to ERIC or "^had acquired 
a document . fi^fim ERIC, ' Although the authors give no reaspns 

^ ' • ' ' ) ■■■■ ■ ''^^/-' ■ :.. . 



for, such underutilization, 1;wp. differences between users ,^ 
and; nonusers that emergie aire iri^^^^tional ,af filiation 
ariid -prof essional involvement. Users tehded to be .asso^ 
ciated with nonacademic institutions and tb be involved 
jCh^ applied research or development work wiile the nbnusers 
tended to bje associated with academic institutions and 
to be involved in basic research. Th^ autihor's posit, 
that the basic researclier participates in an , information 
milieiivwhich is moro efficient than ERIC but that the 
typical applied user does not participate in this milieu 
and relies on ERIC to provide for his or her information 
needs. Another reason for such results might be lack 
of user awareness due to the fact that ERIC had been 
in operation only two years when the survey took place. 

In a later survey evaluating products produced by 
the National Center for Educational Communication (NCEC), 
Wanger (1972) pbtains more optimistic results for ERIC. 
The products evaluated by the author include Putting Re- 
search, into Educational Practice (PREP) reports. Educa- 
tional Materials Center (EMC) bibliographies, and the 
liVPs produced by the ERIC clearinghouses. Wanqor points 
out that of the budgets submitted to the NCEC by the ERIC 
clearinghouses, 40 to 45% of them are For the lAP program. 

The. first part of Wanger' s study is concerned with 
the degree to which educators were familiar with those 
products. Thi^ r(vsuU-.i of .i random sample of 1/188 ediuMtc 
reveal that 87' n of the respondents report familiarity 



with the. products . Specif ically, they had eithe'r read, 
skinuned or were awai;e of the existence of at least one 
NCEC unit. In another part of the study, Wanger investi- 
gated users' evaluations of th^ products in tenuis of 
quality, measured in terms of coverage of the topic, 
up-to-dateness, format, clarity of writing, and thought-^ 
fulness of discussion, and users' evalueteions of utility., 
measured in terms of recipients' use of the product and 
the degree of usefulness, the comparative usefulness of 
the product, and thd reported need and x'elevance of ^ the 
information contained in the product. Results indicate 
•that quality ratings were greater tjjan the midpoint of 
the scale and that the lAPs were meeting the users' needs 
for information on a -continuing basis and, to a lesser 
extent, they were meeting more urgent information needs. 
Users reported that the products were useful in problem^ 

solvinq situations, such' as plannindi; activities , research 

-%> . 

design efforts, course work curriculum design, and appli- 
cation in the classroom with ^students . Also, 50% of the 
users reported passinq along the information to others. 

The problems faced by^ the ERIC system have been 
noted and rocoiumGnda tions for the future have been suggest 
both by Wanger (1972) and Hoover (1972). Hoover points 
out that the literature of education is of such high 
volume and is so we<ak in scientifically verified proposi- 
tions and reliable program eva'luations that syntheses 
of: practical experience and research findings are rare. 



i^dther problem associated with educa'tional . literature 
is its underutilization due to educators • reliance on 
faoe-to-face communication wf th/coi'leagues , - anecdotal 



information, and the advice^/Of others. As mentioned , 

• V ' ' . / • ■ ^ 

* / 

previously, a lack of f aj(niliarity on the part of the^. 
^.target audience with, the services .offered by ERIC is also 
a problem. Hoover also points out that even among tho*se 
familiar with ERIC, there seems to be some degree^ pf 
dissatisfaction, which is reduced when the us^rs employ 
competent information specialists as mediators between 
their needs and^ the ERIC data base. 

fioover sees some arpas as being of specijkl interest 
in ^future planning for ERIC. First, he states that the 



coverage of the liteirature should haVe no substantive 
gai>;S and that it should, include fugitive literature which 
covers exepfiplary, innovative projects arid^p^ctices . 
Also, he emphasizes concern with*the practitioner/decision^ 
maker clientele in that users, need concrete 'answers to ' " 
specif ic <4probiems or a^ synthesis of information around 
the problem to help in their applied work, \ 

../ '"' W anger (1972) also makes recommendations for both 
the ERIC system "and for further evaluation studies, ^ 
.Her recommendatic^s for the system are to develop imprWed 

alerting and annpmicement systems and to improve the 



product deliveryX^stem and/qr intensity the educational 
program oL how to obtain the products. Recouunende\ tions j 
for future evaluation studies state that they should 



11 



include an assessment of the outreach of the product and 
that "a continuing evaluation program should^ be .insti/tuted, • 
to^provide the originatingv units with current feedback 
on NCEC products'' ,(p/ 11-11). % • 

^ In line with this second recoimendatJjan/ t;^^ present 
research project is concerned with the users Q$ the lAPs 
produced by the 'eRIC Clearinghouse on Tests, Measuren\ents , 
'"^nd Evaluation (ERIC/TM) . The project attempts/to measure 
the users* evaluations of. the lAPs in terms of various 
aspects of quality and utility, discussed below. In* 
addition, comparisons are made between the, perceived 
quality and utility reported by those affiliated- with 
colleges and those in other institutions and organizations . ^ 



1 (^] 



METHOD ... . , 

* Subjfect^. ( The sub jects ' Q^.vJ::h3iS$ projectv were com-- 
prisedi'pf. tMose people who have r^questeci,^ information 



;|t^^lysis /pif^uc^ts from the ERIC Cle^rih^House on Tests,' 
Measurements, and Evaluation. TJie •^S'^inpl''^:^^^^ 
drawn from a cumulative list of orders placed from 
January, 1976 to December , 1975 and was based on stratif- 
ications by title of requested report and institutional 
affiliation. 'Table 1 piresents these data. The six insti- 
tutional affiliations used^^or stratification were: 
1) commercial organizations.r 2) state departments of 
education; 3) elementary through high school, including 
voeational schools; 4) school district; 5) universities 
and four-year colleges; and 5) undifferentiated, those 
for wKom it was imposs^ible to assign a category. Looking 



Insert Table 1 about here 

at Table 1, one can see that the largest number of re- 
quests came from those affiliated with colleges and uni- 
versities and the fewest came from those associated with 
commercial brganizations . Based on the total number of 
requests, 8,420, 301 were chosen to be in the survey. 
The number within each institutional af f i liation is entered 
into Table 1 in > parentheses . 



V , ■ . ■ -V. ■ . ■ ■ ■• y 
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Questionnaire . The 'basic purpose of the question- 

nair& 'was to assess the, requestor* s evaluation of a * 

particular docuinent which she/he had ordered.-' Specifically, 

the areas covered include: 1) the type pf institution 

or organizat^dn with 'which the requestor is affiliated; 

2) the type of professional activities engaged in' by -tjjhe 

reques4;orr 3) the relationship between the above t; 

demographic^characteri sties and the type of report \requested; 

4) how the requestors became aware of the document in 

question; 5') whether 'the requestors were , the target popi^" 

lation of the^ clearinghouse; 1 6 ) whether the requestors 

had received the requested document and, if 'so, the extent 

of reading they had done; '7) the qualijrty of the document; 

and, 8) th^ utility of the document. 

These last two que-^tionnaire areas were comprised 

of various dimensions. Qukid^^ty wag judged on the length 




of the document, the ofganii^ation, the writing, a'^nd th^ 
format. Utility was assessed accordirig to the requestor's 
expressed purpose in ordering the product and the extent 
to which this purpose was fulfilled, whether the information 
in the information analysis product was passed on and, \ 



if so, to whom and in what form. Utili 
also by asking the requestors "to, report 
information on their subsequent work: ac 



was measured , 

\ 

any imt)act of theV 



livities . Open- 



ended questions were also included to aiLlow the ifespondent 
to report any special effects the mf oriya tion had on 



'f . ■ - 14 

■ ■ ;. ■ 

his/her work and to provi^^^-etrvy suggestions. See Appendix 

.A-1 for a copy of the questionnaire used in the study., as well 

' • ' ^ v ■ * 

as the cover letter which aiccompanied it in Appendix ".A- 2 * 

\ ' r * " ■ ' " I ' ' y • . ■ 

/ Procedure, The fi'rst step was to organize the in^ . 



dividual requests by report number- and affiliation of 
the requestor. Following this, a sample of 301 was chosen 
bas.ed on a sampling fraction of approximately 1/28. 
' The questionnaires were then sent^^to the^ chosen 

■ ■ \ " ■ 

sample along with a cover \etter and a stamped envelope 
for returning^ the completed questionnaire. The cover 
lettet explained that the researchers were .studying eval- 
uations of the information analysis products of -ijhe ERIC 
Clearinghouse on Tests, Measurements and Ev^luatipns - 
and -th^t the questionnaires were being sent to a randomly 
selected group who had requested particular repbrts. 

Analysis . To evaluate responses to the 'question- 
naire, the first step involves a f reqweucy^an^r^^s of 
the responses of those who report receiving the requested 
documents. This gives the overall evaluations (6 f 'quality 
and utility. Also, the demographic characteristics, 
especially institutional affiliation, of^ those rei^orting . 
not receiving the documents are investigated to reveal^— -^.^ 
any differences between these people and those who report 
receiving the documents. 

Additional analyses include the relationships be- 
tween responses (e.g., institutional affiliation and 



1 i) 



evaluatio-ns .of: 'quality and utility) , ■ Open-ended questions 
are Subjected to* content analysis to reveal any raa'jor 



categori-es * ih the answers . 



if 0 



• RESULTS . y 

Of the 301 qaestionnaiifes mailed,- seven we^/^e returned 
due, to their being \md^liverable, or duej^to the death 
of the requestor or the requestor's moving, thus reducing 
the sample to 294. Of these 294 remaining questionnaires, 
a fairlyhigh response ,rate of 50% (i.e.V 149 respondents) 
was yielded . 

The results of evaluation questionnaire can 

.be discussed based on some .general "c^^^go t ^gjtau ^ 1) whether 
the requestor received the . document ;\ 2 ) th^ demographic 
characteristics of the recipients; 3) how the recipient 
became aware of the ' document ; 4) the respondent's work 
in the. same , area as the particular dociiment'; 5) judgments 
abqtat i:he quality of the information analysis product; 

/ • 

and, 5) the stated utility of the product. 

The^ j/irst topic evaluated deals with whether the 

/ . ■ ^ ^-z . 

respondent received the requested document and , if so , 



to what 4^tent was it read. Of the 149 people return- 

J \ 

ing th^^'^uestionnaire, 99 reported receiving the partic- 
ular inf ormation analysis product , 44 said they , jhad not^ 
rec'eived the document, and 6 could not>yrecall receiving 
the document in question. 

The typical respond'erit' receivj.n^ the requested docu- 
ment has a post-graduate degree in education and works 

■ . I ~ 

( 1 r 



for either a university or for an elementary, secondary 
or high school. Specifically, 94.7% of the respondents 
who received the docioment have a post-graduate degree, 
with 46.3% having masteirs • degrees and 48.4% having ^ 
doctorates. A large majority (46.5%)' of the respondents 
have degrees in education, while only 13.1% have degrees 
in psychology and 10 . l?o have degrees in educational' psy- 
chology. The final demographic characteristic tapped^ 
was the resporidet^ts ' place of emtDloyment. As would, be/ 
expected given the sample, the* results .indicate that / 
more than a third of tfiole receiving the inVoririatiqh 
analysis produqts were* affiliated with a university or 
four-year college (34.4%), while 30^2^ of ^hem w^re work 
ing in elementary, *s'econdar^>' or high schools. 

Table 2 shows _ the demographic characteristics of 
those receiving the documents &nd .those who report not ,, 
receiving* them. Looking ^it this table, one can see that 
those who report not receiving the documents are not ^. 
significantly different from the^^4cipient3 . A& is the 
ca^e with the largest groups are those 

affiliated with .universities or colleges and those work- 
ing -in elementary , middle, or high schools. ^ 



^ Insert Table 2 about here 

* The third, area of interest deals with how th(^ ' 
•requestor bocamo aware of the particular documents. 
The majority (63.3?i) report havincf seen the document 



lifted in an. order .form from ERIC/TM. .This source was 
by far' the most- frequently cited as the next* most f-^re- 
quently reported source, "having read t)j\^ abstract in 
Research in Education," was . mentioned by^ only 13.3% of 
those who listed their sources. Table 3 liiSts the sources 
of awareness and their reported frequency • 

— :_ ■ 



" Insert, Table 3 about here 

' 5 . — 

Th^ next category of inform'ation which the question- 
naire covered is concerned with the requesters' worli - , 
in thevsame area as the ^prodiict in question. The majSr- ■ 
ity of respondents (^53.5%) cited doing research and 
development work or supervising such work and making ^ 
decisions while the least ci^ted work in the area wag 
pnep^ring ' an external 'document H^- g --;^ ; journal article 
or' report) . Table 4 lists the- respondents ' work in the 
area represented ^toy. the document. ^ 



Insert Table 4 about here 

^ -— — 

The next section deals with the purpose for which 
the requestor ord^rt^d -the dOGumer>t,, and his/he'r judgment 
as to how well these needs'* anQ purposes were fulfilled. 
There \Ne]c:e three possible . responses to each purpose!? J.is teds 
1) relevant, did fulf ill^, 2.). 'televant , did not fulfill 
and 3) irrelevant. The third category was included under' 
the assumption that sonu» requestors would order a docu^ 
ment thinking.it Wa's xelateiji to a particular topic or 



application' of that i topic , when, in fact, the^ report covered 
another area . lt '\fjka hoped that this would differentiate 
those instances' in Iwhich the paper covered the desired 
topic but did not fulfill the user's needs from those ^ 
-in which the. actual topic was irrelevant to the desired., 
topic. There seems to be evidence, 'however, that this 
third "irrelevant'^ ' catego'ry^as^ not totally understood 
by the respondents and it wi 11 be lef t out of thi s report . 
The two most /frequently cited purposes which .Vfere fulfilled 
were "to keep as a potential reference tool" and "to up- 
date knowledge in a familiar area; V while * the least fre- 
quently cited fulfilled purposes were "to 'obtain an in- . 
troduction to a new subject" and "to look up needed facts." 
Very few responded that the purpose for whic^^^ they ordered 
the > docunient had not been fulfilled. The most frequently ^ 
cited unfulfilled purpose, "to find out who is working 
on what area or what problem," was cited by only 16.3%. 
of those who^'Checke.d, this as one of their original pur- 
poses and invo;l^ve;'s 'drily six respondents. 

' The quality of -.the particular in: ormation analysis 
product vas judged on four dimensio: .;: length, organi- 
zationy writing, and f ormat (i.e ., physical layout, 
illustrations and typography) . A few respondehts did not 
fill in this portion of the Questionnaire, statiing that 
they ,\;\frid read only the abstract or .had only scanned the 
document and did not f (H-I quali t i(Kl to. respond. OL tho 



89 cases responding to the length dimenj^on, an over- 
whelming ma jority (85 .4%-) judged the length to be ^Vabp^ut j 
rigl>t . Of . the 88 people responding to the otganiizatlon 
"dimension, 94.4% j.udged the document as satisfactory 
or better ( 11 . 4% 'excellent , '33 .0% mbre tha^;i* satisfactory , 
and 50.0?^ satisfactory)-. The f ewest number^ of people 
respo^nded bri t'fi'e writing dimension, perhaps because a 
number of the documents were bibliographies and tHe ques- 
tion may have seemed somewhat irreley;ant ; . Howgyer, of, 
the 85u.making such judgments, 95 . 3%'^^f ound t,hp. writing to 
be satisfactory or better (20.0% very cle^r., 28.2% more 
than satisfactory, and 47.1% satisf actojry ) 

category, the rformat, was also'S' judged to be^ of high qualify 
with 33 v.0?o judging the format to be helpful to reading 

and understanding' fend. 31.8% finding it somewhat helpful. , 

' t. . * ' •. 

(See Table 5 for summiary of results.) 



Insert Table 5 about here 
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Utility was assessed along /two other (dimensions, 
along with fulfilled purposes and ne<^ds: 1) whether 
the resporident reported passing the informatipn in the ' 
document along to dthers, if sq, to whom and in what 
form; and, 2) whether they^ reported taking some sort of 
action as the jtresult of coming in contact with the infor- 
mation in the document. Looking at Table 6v.one can see 
that 46?o of the respcindents reported passing along some . 



or 



ihforn)^t jL'.g).n with 76% of • tlijiese"* passing along the docuinent , 

itself . >The secondvdimension^ ,.the' impac of thie informa-' 

tion on, the respondents'* work, jrielded very, positive' re-r 

siilts wifch 589^^^ b^^^ reporting, such an impact . 

These, d^ta . are also repo^-ted in *'£^ble'6. ^Mdst of those \ 

who cited some impact -sa^d they applied the inforih^ti-on 

to some, aspect ( s) of thei r own w^t-k; These .two . dimensions, 

, ' ^^^^^ ■ ' •• 'i 

, passing t^he irlf ormati;ip^n - i^ipng and im^ of the inf ormation, 
•along with the results repdrted concerning inf Qjpnrktional 
needs and thei^r f^ilf illmfent wquld seem i:o indicate that " 
the inf orn1atq:on analysis products are ^.^erving arj ; important 
purpos^'...ln the work 'of the responderjts . 



Insert:; Table 6 about here • ' 

. - vJv' V ^ '■ 

The responses to open-ended questions are l.isted 
• *in th,fe ' Appendices . Other sources of'^awareness .bt the 

reqvie'sted document, listed in Appendix B-1 , , infclu(3du6the.t , 
EKIC pubiicatibhs, a general, knowledge of ERIC publicationgj, 
. and other informatibn se'.rv^ices. Appendix B-2 lists other • 
' ' v/ork in the areq^s represented by the documents. As 
reported, the two general' areas aire i^pplied work antd 
administrative work.' In addition, two respondents cited - 



••classwork . " .\ 



The purposes listed in the open-ended section of 
question 4 follow from the work areas listed above, are 
repotrtAd ^it^':Appbndi: x B-3 . V .Finally respondents ^ comments 



pn any Special "effects of the documents and their 
suggestions are listed in Appendices S-4 and B-5, 
respectively. 

Comparisons of respfpnses of coli^ege faculty and 

■I 

others. The. data can be analyzed to investigate the dif- 
ferences among people' s .responses and evaluations of the 
documents. The majo»r interests yill be tl^e? relationship's 
between certain demographic characteristics (i.e., highest 
degree, area of degree and institutional affiliation) 
and other aspects of the survey questionnaire. " An in- 
teresting comparison is that between those affiliated 
with xiniversities or four-year colleges"*"andf those working 
in elementary, middle or high schools. 

A greater percentage of those affiliated with ele- 
mentary, middle or high schools report reading the entire 
document (37.9%) than do tl-^e associated with univer- 
sities and four-year colleges (30.3%). ' Hovfever, the 
pattern for both , is the same with most people reporting 
scanning the (document jas was the case with allmost all 
of the institutional categories. An exception to this 
is found in the state government category. Most ^these 
peopVe (i(i57 .,1%) report reading the entire document rather 

than scannirig.^th^ document, reading the abstract only or 

■V ' ' \ i/r' , • 

noh^^ reading! the dociOment or the abstract. ' This is based 
on a very small sample (n+£«) and should be interpreted 
'with caution.' 
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There is a difference between those affiliated with 
colleges and those in the schools in how they became aware 
of the specific document.- A large majority of those affiliated 
with the universities report having seen the title on an 
.order form from ERIC/TM (71.9%) with each of the other 
sources mentioned by fewer than 10% of these respondents. 
This can be compared' with the practitioners in schools of > 
whom 13.8% mention having "read the abstract in Research 
in Education , " and 62.1% report having seen the title 
on an ERIC/TM order form. However, the pattern remains 
the same for all institutional affiliation groups, with 
the most cited source being the ERIC/TM order form, followed * 
by the Research in Education abstracts. 

The third question in the survey, intended to assess 
the type of work done by the respondents in the same area, 
as the document, would be expected to reveal differences 
for the basic researcher and the practitioner. Table 7 
lists comparative «data for the relationship between the 
institutional affiliation of the respondents and their 
work in the area. . Those who work in universities and 
colleges are abopt equally divided into the categories 
of "conducting research pr development work" (24.2%), 
"Supervising research and development work" (21.29^), and 
"teaching" (24.2%), with the remaining quarter distributed 
in the "preparing internal document," "preparing thesies 
arid dissertations," and "other" categories. Those 



affiliated with elementary, middle and high schools, 
on the other hand, most frequently cite the "other" 
category (39.3%), "conducting research and developJlent 
worJc" (21.4%), and "supervising research an<^ development 
work" (25.0%) as their work. As mentionecj^previously, I ^ 
the "other" category was content analyzed to reveal the 
major work categories entitled "applied work" and "admin- 
istration." The specific activities appropriate to those 
in schools are curriculumiid^velopment , selection of appr6- 
j)riate tests and the work of school principals. ,^ 



Insert Table 7 about here ' , 

Comparing the different institutional groups on 
the basis of the purposes for ordering the documents 
involves looking at the number of people who mehtion 
a specific purpose as fulfilled or unfulfilled on ^ the 
fourth question of the Sfurvey in relation to the total 
number of people in that institutional category. As , 
mentioned previously^ the "irrelevant" category is not 
included in these analyses. 

Those in colleges and Universities anc^ those in 
schools are similar in their- most often cited purpose's. ^ 
The first for each is "to keep as a potential 'reference 
tool," with 22 of the 29 respondents affiliated with schools 
mentioning this' and 29. of the' 33 ' university people 

V. ■ ' 



mentioning it. This , purpose is followed by "to update 
my knowledge in an area with which I am familie^r,'' with 
nineteen df the people in schools mentioning this and 
.^twenty of ^those in universities mentioning it. 

Evaluations of quality, judged on the length, or- 
ganization, writing, and format of the document, are 
reported in Table 8 by institutional affiliation. ^ Look- 
ing at this Table, one can' see that those affiliated 
with universities judge the document as more satisfactory 

in length than do those in the schooJUs, whose evaluations 

' X' ^ ( 
are distributed, to a greater extent! in the "somewhat 

long," "somewhat short" and "definitely too short" 'cate- 
gories . 

More positive evaluations by /.the loniversity and 
college people than those in the schools are. also seen -^^ 
in the "organization of the document" dimension, as can; 
be seen in Table 8. Ninety-s:v^ percent of the university/ 
college people judge the organization of the document as 
satisfactory or better compared with 89% of those in 

schools . ^ 

•' - '\ . . . 

Insert TablJ 8 about here " \ 

' • ^ ■ ■ . • y 

similar to these evaluations, the judgments made ^ 
on the writing dimension by the university and college 
people tend to cluster more at the high end of the scal^ 
than do those made by the people in the schools. \ For 



kJkJ . ^ 



example, 33.3% of those in universities juoge the writing 
as more than satisf actor^y while only 12.0% of those iri . 
schools chose this evaluation: 

The final quality diitfension taps the degree to which 
the format of t,he document assisted thie reader' in under- 
standing and readability. People in universities found 
the format much more helpful than those in schools, with 
42.9% of those rin universities choosing the highest point 
on the scale as opposed to 22.2% of those affiliated with 
schools who made this response. \ 

The next two questionnaire areas Heal with aspects 
of the utility of the document and how they relate to 
the institutional aff illation- of the- respondent . TKe first 
aspect, passing the information in the document along to 
otjiers, is reported by a greater percentage of those in 
the schools (48.3%) than those in universities and colleges 
(42.4%). For both, the most frequently cited mode of 
transferring the information is "p^psingyalong the docu- . 
ment itself." This is true for all the institutional 
affiliation categories. ; 

The second area -of interest, the impact which the 
-document has on^ the '.respondent • s work, can also be thought 
of as an aspect of document utility . The comparison 
between the basic researcher and those in applied settings 
yields some differences. Those affiliated with univer- 
sities cite a greater frequency of such impact (63.6%), 

31 



with the majority of these (57.7%) reporting that they 

have applied the infornration in the docuxneiafE to some aspect 

Of their work • Fifty- five percent of the respondents 

affiliated wit)a schools report taking some action as the 

result of reading the dociament.,- The most frequently . ' 

cited actions are orcJering a reference listed on the docu- 

ment and applying the information in the. document to some 

•aspect of the respondent's work activities. 

Evaluations of document quality can be compared on 

the basis o^f the respondent's highest degree and the 

area of that degree • Comparing evaluations of dociament ' 

length for those with bachelor's, master's or doctorates ' 

\\ . 
yields no substantial differences. Evaluations, of dociament 

organization do differ by the , respondent • s highest degree. 

Seventy-five percent of those with bachelor's rate the 

dociament as excellent or tnore than satisfactory in terms • 

of organization as opposed t6 41.1% of those with master's 

and 45.2% of those^with doctorates who make such evalu- ' 

^tions. Evaluations of the writing dimension differ very 

little as a function of the respondent • s ^degree level.' 

The final dimension, format, is rated lower by those ; ' • 

with master's degrees, with^6. 4% rating, the format as 

helpful or somewhat helpful, than by those with bachelor's 

degrees or doctorates. Seventy-five persent of those 

with bachelor's degrees rate the format as helpful or 

somewhat helpful while 71.4% of the respondents with 

doctorates make such evaluations. 



Evaluations of. document quality by area of degree 
follow the same pattern throughout the dimensions. Those 
with degrees in psychology consistently rat^ the quality 
lowest; people with degrees in educational psychology 
rate Quality highest and those with degrees in education 
or in other areas fall in the middle. 




DISCUSSION i 

In assessing the, users' evaluations of the infor- 
mation analysis products produced by the ERIC Clearinghouse 
on Tests, Measurements and Evaluations, the results' of 
this survey indicate that the recipients of these reports 
find them to be" of high quality and to be useful in their 
work. ' ■ . - 

Evaluations of the documents are extremely high. , 

/ ■ ■ 

Although there are some small variations, with those 
people possessing post-graduate degrees and those with 
degrees in psychology. evaluating the documents somewhat 
iQwe'ir, in general, all the recipients found the documents., 
to be satisfactory in terms of length, organisation, 
writing and format. 

In general, the respondents seem to indicate that 
they found the information in the documents useful in 
their professional activities. Very few people report 
being unsatisfied with the products in terms of fulfi^Ll- 
ing the needs and purposes fpr which they were originally 
ordered. On the other hand, many respondents found such 
needs fulfilled. 

The fact that almost half of the respondents report 
passin^g on the information in the documents, with, the 



great majority of these passing oh the document itself, 

also rteflects well on, the usefulness of the inforrnation 

analysis products in the users'' professional activities. 

In addition, more than' half of the respondents report 

some sojrt of impact which the information had on their 

work. These three facts, that the documents fulfill *> 

y ' " . . . ' ■ 

informational needs, that users pass, on the information, 

•• • ' • 

and thc^t there is a high frequency/ of .^reported impact,, 
point to the conclusion that the information is highly 
useful to Educators. 

When reporting on the specific purposes for order- 
ing the documents, the recipients cite "to update know- 
ledge in a familiar area" and "to use as a potential ref- 
erence tool" most often. Analyzing the data by institutional 
groups reveals the same two purposses ^^s those most often 
cited by each group. The :i.east frequently mentioned ^. 
purposes, "to look up needed facts" and "to obtain an 
introduction on a new area" were found for the, entire 
respondent, group as well as for five of the^ seven insti- 
tutional affiliation groups. The reason for thes^ being 
infrequently c.i ted might be the existence of other, more 
readily available, sources of information to perform 
these functions* Libraries with updated periodicals 
may be moire convenient and useful in fulfilling moj^e^ 
urgent information needs while the information analysis 
products may be more useful as sources of continuing 
educational research information. 



The requestors' purposes in ordering the document hre 
related to their work in tJne ^rea. That is, the most 
aften cited 'areas of work' are ccmducting research and . 
development work and supervising research and development" 
work and decision making • To the extent that these are 
on-going processes in which educators have continuing. '. V 
interests, the most - frequent purposes, "to update krlowledge 
in. a familiar area" and "to use as a potential,, reference 
tool" would seem logickl for these types of work. 

Another ^important result is the number of people 
.who. report either reciding the en'tire document or scanning 
the document. Becau'^^this indicates rather "extensive 
reading' of the material, it would seem to add relialD^-lity 
to the respondents' judgments abput the quality and utility 
of the information in the documents. Caution mUst be taken 
^in- interpreting any of the data in this survey V however. 
Although the response 'rate is, higher than expected, it 
is possible that those who returned the questionnaires ^ 
represent some biased sample. 

'fhis fact - is especially important when interpreting 

■A. . ■ ' ' ■ ■ . . *'••'; 

the fairly high number of : people who report not receiving . 
the . requested documents. ' It is possible that thefee respon- 
dents are not entirely 'representative of the total pop- 
ulation'of requestors. Discoianting this, that fact th^t 
29.5% of the respondents report not receiving the requested 
documents seems fairly high. Because the unfulfilled 



llreqUests are not for a certain groUp of inf orn^iation ; 

\- " ■ ■ «• ' , ■ 

analy&is products ahd these requestors are not an identic . 

• fiable sub-group of the population, ther'^ .seem3 to be 
no obvious reasoA' for this result. Perhaps .the most 

* salient and logical . explanation' would be that the 'fcequests,;;!^^ 
may' haVa been receiyed' by, .the 01^^^ all 
copies ^of the' requested documents vhad been distributed • 

V.;?- ' ' In summary, these information' analysis products seem 
to be"ref eir^nce tools which are skimmed or read by edu- 
cators to remain abreast of the voluminous mat:erial in the 
educational^ research area. Perhaps they are more closely 
examined ^fhen specific needs arise. In addition,- the 
information in the dociaments seems to be applied to the 
educators* work, regardless of the particxilar are^v(i"- ^. . / 

'^^ Another important finding is the surprising similarity 
among the various sub-gtoups in tezTtis of tfieir overall • 

" high evaluations.. of ^tlje documents as well as their fre- 

^ quently^ cited utilizations of the inf,ormation in' their ^ 
work.' These products seem to be ,accomplishir^g their 
goals of providing" educators with an overview of educational 
research as well as having an impact on their work. ' r- 
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FOOTNOTE 



Although the f undlngl'f or this research vaS provided 
by. th^ Educational Reisources Information Centeir 
Cleari^nghouses Oi^;^ 1?estSs, Measureiri^nts and Evaluation, 

:,th$ Qjpiriibri^ expressed in • this .document are not necessarily 

.' .... 

':th6s^'-^f-;;ERIC/TM. . / - 
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Table 1 

Number of Requests by Requestors ' Affiliation 



Requestor Af f i liat ion 



N = 8,420 (301); 



Commercial organi zation 

State Department of 
Education 

Elementary through 
High School 

School District 

Universities and 
Colleges 

Undi f f erentiated 



199 

372 

767 
1,096 

3,193 
2,793 



(7) 

(14) 

(29) 
, (39) 

(112) 
(101) 



chosen 



for 



Table 2 

The Demographic Characteristics of 
Recipients and NonrecijJients 



Recipients Nonrecipients 



Institutional 

L. JL JL JLCi^ JLyJlL 






Percent^ 


jj X eine n u a ry/ 
High School 


30 




36 


Junior/Cominunity 
College 


6 




2 


University/Four- Year 
College 


35 




31 


Federal 


. V 7 




7 . 


State 


3 




2 J 


Local Government 


3 




17 


Other 


16 




5 


Area of Degree 


Percent^ 




Percent'^ 


Educational 
Psychology 


11 




20 


Education 


52 




55 


Psychology 


15 




10 


' Other 


22 




15 


highest Degree 


Percent'^ 




Percent^ 


BA (BS) 


4 




5 


MA (MS) 


47 




52 


Dortora t e 


, 49 




43 


^^N- = 9b; i^N - 42; 


= 89; '^N = 40; 


"^^^ 9 5 





i. 

i 



Table 3 

Source of Awareness of Document 



Source 



'Frequency^ Percent. 



Research in Education 
Colleague 

Order Form from ERIC/TM 
Computerized Search 
Elsewhere 
'TOTAL 



14 
•6 

64 
8 

8 

100 



^ N = 97 



' Table 4 

; Recipients' Work in the Area 

Reptesented by the Document . , 

. - - ' , • ■ * ■ ' ^ 

Work Area Frequency Percent^ 

^ . ' ' - < 

Conducting Research and 

Development ^ '33 

Supervising Research and 

Development 22 

Preparing Internal Dociamefits 

(report, memo, etc.) * 7 

Preparing External Documents ■ r 

(journal article, etc.) 1 

Preparing own Thesis or ' 
Dissertation 4 

Teaching a Course " 9 

other 24 

' ' — ; ■ — • — 

^N' = 98 



, . : Table 5'. 

Recipients' Evaluations of DOGument Quality 



Lenath 


Organization ' 


Writing 


Format 


Scale Point 


Fre- 

quency 

Per(:ent^ 


Scale Point 


Fre- 
Percent 


Scale Point ' 


Fre- , , 
duencv 
Percent" 


Scale Point 


Fre- \ 
quency , . 
Percent 


Definitely 
too long 


0 


Excellent 


11 


Very 
Clear 


•20 


Helpful, ' ' ' 


33 " 


Somewhat 
long 


8 


More than,, 
satisfactory 


33 ' 


More than 
satisfactory 




Somewhat 
■helpful 


' 32- 


About- 
right 


86 


Satisfactory 


51 , 


Satisfactory 


48 


Did not 
affect ' r 

i 




Somewhat 
short 




Somewhat 
unsat- 
' isfactory 


< 

■ 5 


Somewhat 
unclear ., 


■3' ■„ 


Hindered, 
somewhat 




Definitely 
too short 


l 


Definitely 

unsat- 

isfaqtory 

1- 


0 


Definitely ■ 
unclear 




Definitely 
hindered 


1 



Table 6 

Evaluations of Two Dimensions of Document Utility 



'assing Information 



Frequency 

Percent^ Impact of Information 



Frequency 
Percent^ 



^assed on document itself 



lummarized findings in a memo 

V 

Verbally discussed findings 
> 

)ther' 
'OTAL 



80 



V 



Ordered rejference listed 
in document 

Applied information to 
own work 

Examined related documents 
not referenced 

Consulted with author (s) or 
persons(s) identified 
with document 

TOTAL- 



21 



54 



100 



18 



100 



3m - 



N = 45r N = 57 



ERIC 



47 



Table 7 

Relationship of Recipients' , Institutional Affiliation to Work in the Area 
) ¥ep|ps'e,i]ted by the Document 



' t Preparing - : ' ' 

Conducting Supervising Preparing Preparing Thesis or Teaching' 

Research & Research & Internal External Disserta- a 

Institutional Development Development IJocuraent Document tion Course Other 

Affiliation Percent Percent Percent ^„ Percent Percent Percent Percent 



Elementary 
through 
High School 
N = 28 

Junior and 
Community 
College 
•N = 6 



21.4 



33i3 



University 
and Foyr-Year 
College 

N = 33 ■ 24.2 



25.0 



16.7 



21.2 



7.1 



15.7 



9.1 



3.6 



3.6 



6.1 



39.3 



33.3 



24.2 15.^ 



•Federal 

Government , 

N = 2 50.0 



50.0 



,0 




' ^ Preparing ■ 

■ ■ ^ _ Conducting Supervising Preparing Preparing ' Thesis or , Teaching 

• _ • Research & Research & Internal External Disserta- a 

Institutional Development Development Document' Document tion , Course, Other 

Affiliation Percent Perce nt Percent Percent Percent Percent '■Percent 

— - — — ^ ■ r— . ' I .. "— — ' -'-'^ — — 1 ~ — ' r- *— t -. ' ~ — 

/State /, ; ' -r' ■ ■ 

.Government ' ^ 

N = 7 . 57.1 28.6 'O 0 .0 ■ 0 ■ 14-.3 

Local ■ '• 

Government , ■ r ^ 

N = 3 . ■ . 66.7 ' ^ ; 0 , 0 0' ■ ■ 0 0' " 33,3 ■ 

Other • ' ' . , 

N = 16, .56.3 12.5 6.3, 0 6.1 0 18.8 



Table 8 

Relationship, of Evaluations of' Dd'cument Quality . and 'the. 
'>y ' Institutional Affiliation of the Recipientis 



I 



■ D^finijtely 
too long 

Somewhat 
long 

^ About 
right 

. Somewhat 
short 

Definitely 
.too short 



.: University ' . . 

. ;' Junior' and and 'Four- Federal State Ml,-,,, 

Elementary/ Community Year Govern- Govern- Govern-- 

High School College College ' ment ' ment. ' ment • Other 

Percent Percent : Percent, Percent Percent Percent Percent 



0 

14 
78 



4* 



•0 , "v 



iod: 



■0 



89 



100 



29 



71 



0 ;,':G 



100 



93 



l7 



Total 



100 



100 



100 



100 



100 



100 



100 



Table 8 (Cont'd.) 



' , University 
Junior and and Four- Federal State local 
Elementary/ Cotranunity Year Govern- Govern- Govern- 
High School College College ment ment ment Other 
Percent Percent Percent Percent Percent -Percent Percpnt\ 



Organization 



Excellent 



11 



0 



15 



50 



0 



0 



13 



More than 
satisfactory 



19 



Satisfactory 59 



83 
17 



22 
59 



0 

50 



57 
43 



67 
33 



47 
33 



Somewhat 

unsatisfactory H 



4 



0 



0 



0 



0 



Definitely 

unsatisfactory 0 



Total 



100 



.100 



100 



100 



100 



100 . • 100 



Table 8 (Cont'd.) 



University 

Junior and and Four- Federal State Local 

Elementary/ Community ^Year Govern- , Govern- Governr 

High School College College ,ment ment ment |Dther 

Percent Percent Percent Percent Percent Percent Wercent 



Hri'ting*^ 



Very clear 



20 



17 



22 



50 



14 



0 



23 



More than 

satisfactory 12 
Satisfactory 64 



33 

50 



33 

41 



0 

50 



43 

43 



33 

67 



46 
23 



Somewhat 

unsatisfactory 4 



0 



4 



0 



0 



0 



8 



Definitely . 
.unsatisfactory • 0 



Total 



100 



100 



100 



100^ 



100 



100 



100 



ERIC . . 



y.1 i 



0\ 



i 



Table 8 (Cont'd.) 



. ^ , University 
, Junior and and Foud Federal State Local 
Elementary/ Coinmunity Year J Govern- Govern- Govern- 
High School College Colleger ' went ment ment Other 
Percent Percent Percent Percferft Percent Percent Percent 



Format^ 
















Helpful 


. 22 


33.3 


43 




50 4' 


' Q 


43 


Somewhat 
helpful 


37. 


33.3 


25. 




, * 

,33 " 


. 0 


• 36 


Did not , 
affect 


33 


33^3 


29 


f 'SO 


17 


■67 


14 


' Hindered 
somewhat 


. 4 


0 


3 

i 


0 , 


0 


33 


7 


Definitely 
hindered 


4 


0 


0 


0 


0 


0 


0 


Total . 


100 


100 


100- 


100 


100 


100 


100 



= 83| ''N = 86i '^N =83: ''n = 66 



58 



er|c 



59 



1. U«v« you received a copy of the requested document? Yes. No. 

If flo, skip to question 10. If Yes , have you: 

Read the entire dt>cument ^ . 

Scanned the document ' 
Read the abstract 'of the document 
Have not read document or abstract 

2. Prior to retiiuestlng a copy of the document had you: 
Read the abstract In Research In Education 

Informed of document by colleague (In own Institution or oth^r) 

Seen the document listed on order form for ERIC/TM , 

Received the title In computerized search 

Obtained information elsewhere (Please specify) ; ^ 



3i Please Indicate your wor^ In the same area(s) as the document:: 

■ . \ 

H Conducting resesrch or development vork 

Supcrvlalng research or development work/decision making 
Preparing Internal document (report, memo, etc.) 

^Preparing external document (Journal article, report, etc;)-^ 

Preparing your own thesis or dissertation 

Teaching a course 

Other (Please specify) . ' _ ' . 



What was your general purpose (s) in requesting the document' and to what 
degree did the document fulfill these Information needs? Indicate aa 
many as are applicable: 

Relevant ; Relevant ; 

Did Did not Irrelevant 

fulfill fulfill for purpoac 



(a) To obtainan Introduction' 
on a new- subject 

(h) To find out who Is working 
on what area or what 
I problem 

(c) To Identify relevant, 
literature references 
In a new area 

(d) To up-date my knowledge 
In an area with which 

I am familiar 

(e) To l,pok up needed facts 

(f) 'To keep as a potential 

reference 

(g) To use for st^Ulation 
and browsing 

(h) To use In other aspects 
of my work 

(Please specify) 



GO 



Plaaaa circle ch« daacrlpclon moat accurac*.- In describing your avaluatlon .oit 
tj;ia documanC in tarma of quality: / ^V' ^ 

(a) Waa. the.^docunant; ,* 

definitely somewhat j^ib^ut soaewhat definitely 

too long long right short too short 

(b) X^ie organlzstlon of the document was: 

excellent more than satisfactory , aomcvhat definitely 

aatlsfactory unsatisfactory unsatisfactory 

(c) The writing of the document was: . ■ , 

' , "■ "I ' * 

very more than- satisfactory somewhat definitely 

clear satisfactory unclear unclesr 

(d) The format (physlcsl. layout; Illustrations, ^ typography) was; 

helpful to^ somewhat * did not hindered definitely 

readability helpful .affedt aoraewhat ^ hindered 

and under* 

standing . ♦ ^ 

Did you pass the Information In the dociiment on to someone else? 

Yea, Colleague, Superior, ''Subordinate (Please circle) No. 

If yes, ;dld you: " (Check all that apply) 

^Pass on .the document Itself ' 

^Summarl^e the findings In a memo 

yerbally discuss the findings, in a memo 

Other. (Please specify) : ' . ' ' . - - ' 



After reading the document, did you do any of the following:' 
_Order reference listed in the document 

^Apply the .Information to my own work activities (Please Indicate areas as In 

question 3 above (a) through (g) ) 

Examine related documents hot referenced 

^Consult with author(s) or pcrson(s) Identified with the document 
Spec'lal effect'on work (Please specify) ' ^ 

Please Indicate any sp^lal effects on your work: 

Please Indicate below any suggestions or elaborations on your answers: 

Please name your highest degree. Institution awarding It, date and area 
In \>hlch you received this degree: 

» Highest degree . Institution Date ^. 

Education Psychology 

Education (other than Ed, Psy.V 

^Psychology (oUier than Ed, Psy,) • 

Sociology 

^Other (Please Indicate) . 

' « . . 
What Is your ma.ior place of employment? 

Elemeutary through high school ^ , - ^ ' 

Junior/Community college (Please specify department or major dept,^ ) 

^4-Year colleger or university (Please specify department . ) 

Government Agency: ^Federal 

S tate 
Local 

\ ^Other (Please specify) 



^^Pl UNIVERSITY O F S O U T H F L O R I D A 

^A?%^ TAMPA • ST. PETERSBURG • FORT MYERS • SARASOTA 

COLLBQE OF SOCIAL AND BEHAVIORAL SCIENCES 
OSMRTMENT of PSYCHDLOOV 
'TAMFA, FLORIDA 33620 

813:. Q74-249a 

■ •• : • ■ ' ' ' ^ 

. ' September 6, 1977 



Dear Colleague: 

i • ■ . . .■ t- ■ , . , ■ 

As part of the requirements for coinpleting my. Master 's 
degree, I fun invefstigating reactions to and evaluations of 
the information analysis products prepared by the Edii^cational 
Resources Information Center (EBIC) Clearinghouse on Tests, 
Measurements, and Evaluations, 

According to the records I have, you have ordered the 
title listed at the top of the enclosed questionnaire, 1; 
would greatly appreciate your taking a few minutes 'to f ill - 
out the questionnaire. and include any other comments you may 
have concerning that report or other reports prepai^ed by' > 
ERIC/TI^. Your participation v/ould be extremely helpiful to me^ 
as well as being a valuable source of information to ERIC/TM 
by providing them with feedback about their products and 
suggestions for any improvements, 

Enclosed is an addressed, stamped envelope for returning 
the questionnaire. Thank you for your assistance* 

Sincerely / 



SEHihmb 
End, 



Susan E* Hensley 
Research Assistant 



APPENDIX- B-1 

Other Sources for E'amili^rity ^ith Document 

List' of ERIC publica?tions and searches , v , 
ERIC/TM Newsletter . 
Resources at ERIC/TM known 

National Association of Elementary School Principal 
Principals* Information Service 



• ^ 52 



APPENDIX B-2 ■ ■ • ' ^ 

, . : , " i ... , ■ ■ ' ■ .. ' .. V ,. - . . , ,. 

Other Work- in Area Represented by Dociament' . 
Appl ied Work . / ; / 

/ 

program evaluation (3) 
school psychologists 
- teaching children, with learning problems" 

" - '. * V 

o curriculum development ^. 
selection of appropriate tests (2) 
research and development ^ and evaluations - 

federal government 
consulting work • 

Administrative Work 

college testing office * 
management of information center . /v 

chairman of vocational education 
screening candidate's for City School Board 
school principal (2) '\ ^ 

librarian ^ 

providing research information to staff 
Classwork ( 2 ) 



. . . . APPFNDI}| B-3 
Other Purpose"'s Reported for Requesting Docioment 



Research and Development and Evaluations 
Librarian ' » 

Research for staff - school and comrnuni,ty college 
Consultant State Department ' of Education 
Provide information to staff 



• , I '-Appendix-- B-4'- ' ■■ " 

Respondents' Comipents on Special Effects 

of Document on Work" / 

^ ■ ■' ■ ' ■ ' ' . ' ' • 

Broaden outlook 

Research for teachers in district— -ERIG has replaced 

professional library resources phased out through 
budget cuts 

Overview of what is happening for practitioners in field 
of education 

Regularly do computer seqirches and updat^e them on annua]^ 
or biannual basis ' ; 

Jr. 

Resource document in subject file 
Reference for work as psychologist 
Added information (2) 
Measurement 

Helped local community 

Looking for an appropriate test and it gave me a starting 

point _w 
Library patrons are educators who need this kind of 

information 
Cited a trend 

Sharing, understanding with faculty 



APPENDIX B-4 , (Qontinued) 



Clarified tea'chirigyabout criterion- reter^ tests 
Benchmark data for evaluation 0f internal ^situation 
Used part of the information:, ift^ a report I wro,te 
Raised the issue to conscious Ifvel vith faculty 
Self gratification; documented .Support 
"improvement of work * ' ^ 

for reference Center 



■ V. 



\ 



I 



■I 



t 
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.\PPENDIX B-5 

Respondents ' Suggestions \ 

ERIC is a blessing in keeping pace with educational 
developments; I don't know how one could operate 
without it. 

The only problem or complaint that I have encountered 
with .ERIC materials is that teachers would like to 
see less project or evaluation reports and more 
research-oriented materials. 

Most of: thi^ ^ inf OL-maL Lor\ receivi^d did not apply to 
my area ot leachinq ( Voc . Education). ERIC Clearing- 
house on Vocational Education , did meet my needs. 

Report too teciwii ca I- - w r i. t' t\^Mi for othiir researchers; 
nei^^d to get down to earth in tt^rminoloqy and 
t H.liu\\ t i on,i I lA'i.i Lncj.s. 



